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DETAILED ACTION 

Response to Amendment 

1 . The Examiner acknowledges the amended claims filed on July 15, 2008. Claims 

1. 3, 10, 11, 13, 15, 17, 18, 21, 24, 28, 29, 31, 32, 35, 36, 40, 42, 45-48, 50, 51, 23, 54, 
56, 57, and 59 has been amended. Claims 6, 8, 9, 26, 27, 39, 41, 43, 49, 55, 58, and 

60 have been cancelled. 

Response to Arguments 

2. Applicant's arguments with respect to claims 1-5, 7, 10, 11, 14-25, 28, 29, 32-38, 

51-53 have been considered but are moot in view of the new grounds of rejection. 

3. Applicant's arguments filed July 15, 2008 have been fully considered but they are 
not persuasive. 

4. The Applicant argues the following: 

a. "For example, claims 4 and 23 indicate the part of the camera apparatus 
that is arranged to be controlled in response to the saliency signal while the 
camera is activated to take pictures, includes image selection circuitry for 
receiving the saliency and image signals and for selectively passing ones of said 
image signals as determined by the saliency signal; see, for example, paragraph 
0052 of the published application. In Metcalfe, such passing is not performed 
while the camera is activated to take pictures." 
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> The Examiner disagrees. Note that in page 6, line 31 - page 7, line 8, 

Metcalfe discloses the following: 

" The LOI signals associated with the video frames can also be used to 
automatically produce a printout of relatively interesting parts of the tape . A 
method similar to that described above can be used to select a subseries of 
relatively interesting frames . Alternatively, peaks in the LOI signals are used to 
indicate frames of relatively high interest . A number of frames are selected from 
the subseries for storage of reproduction . The selected frames can then form the 
basis of a summary page recorded at the start of the series of frames to be 
replayed. 

The selected frames can be printed, optionally in "thumbnail" format, for 
storage with the cassette tape or other storage medium as a reminder of their 
content. In yet another embodiment, the selected frames are reprinted using a 
relatively high quality printer , and used to create the equivalent if a still-image 
camera photo album. Also, t he selected frames can be stored on a computer or the 
like, and used to form a "virtual album" to be viewed on a computer monitor ." 



> This teaches that the images with a high level of interest (LOI) (LOI being 
interpreted as saliency signal as claimed) can be selected for further 
reproduction (i.e. using a printer or monitor of a computer to display said selected 
images in a virtual album). In Metcalfe, by teaching that the images with a high 
LOI would be selected for creating an album or to be printed with high quality 
further teaches that images that do not have a high LOI would be passed or 
skipped since only the images with a high LOI would be displayed in the virtual 
album. Metcalfe as applied reads on "... said part includes image selection 
circuitry for receiving the saliency and image signals and for selectively passing 
ones of said image signals as determined by said saliency signaf as written 
since the display or skip of images is determined based on the LOI set. 
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b. "The office action incorrectly alleges the limitations of claim 20 have been 
discussed and analyzed in connection with the rejection of claim 19. Claim 20 
indicates the user control comprises a pressure or force sensing transducer for 
deriving a saliency signal that can have values that are continuously variable. 
There is nothing in claim 19 concerning a pressure or for sensing transducer for 
deriving a saliency signal that can have values that are continuously variable. 
Consequently, the office action fails to consider the requirements of claim 20." 
> The Examiner disagrees. In regards to claim 1 9, claim 1 9 reads "Camera 
apparatus according to claim 1, wherein the user control comprises a physically 
movable control member and a sensor arranged to be responsive to movement 
of the control member". Metcalfe as indicated in the previous Office Action 
discloses that the user control comprises a physically movable control member 
(pressure button that assign a level of interest of an image signal based on the 
pressure applied to said button) and a sensor arranged to be responsive to 
movement of the control member (See page 4, line 27 - page 5, line 4). By 
teaching a pressure button that assigns a LOI of an image signal based on the 
pressure applied to the button, Metcalfe discloses a physically movable control 
member (in this case the pressure button as discussed in Metcalfe) and a sensor 
arranged to be responsive to movement of the control member since by teaching 
that the LOI is assigned based on the pressure applied to the button, the use of a 
sensor to determine the applied pressure in order to assigned the LOI of an 
image is inherent and necessitated in Metcalfe. Furthermore, in regards to claim 
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20, claim 20 recites "Camera apparatus according to claim 1, wherein the user 
control comprises a pressure or force sensing transducer for deriving the 
saliency signal that can have values that are continuously variable". Metcalfe as 
applied to claim 19, clearly teaches the use of pressure (pressure button that 
assign a level of interest of an image signal based on the pressure applied to 
said button; page 4, line 27 - page 5, line 4) for deriving the saliency signal. By 
teaching that Metcalfe discloses the use of pressure applied to the button, 
Metcalfe discloses the use of pressure for deriving the saliency signal as 
claimed. Furthermore, in the limitations "the user control comprises a pressure 
or force sensing transducer for deriving the saliency signal that can have values 
that are continuously variable", the elements "pressure" or "force sensing 
transducer" are written as optional elements by using the word "or". 

c. "The rejection of independent claim 54 incorrectly alleges level of interest 
button 1 12 of Metcalfe generates a non-playback saliency signal. In this regard, 
the office action alleges the Metcalfe saliency signal is a level of interest signal to 
indicate a portion of the image signals that have a certain degree of interest to be 
stored in memory 120 in association with the saliency signal. However, this 
comment is irrelevant to the requirement to generate a non-playback saliency 
signal that controls picture selection circuitry. The only use Metcalfe appears to 
disclose in connection with the signal generated and stored in response to the 
activation level of interest button 112 is in connection with playback. If the 
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examiner adheres to this rejection, he is requested to indicate where and/or how 
Metcalfe discloses the use of the stored signal derived by activation of level 
interest button 1 1 2 for any purpose other than playback." 
> The Examiner disagrees. Metcalfe discloses that he user can select a 
saliency signal (LOI) to a particular image being captured, the saliency signal is 
stored in association with the image (See pages 5-7). As discussed with respect 
to arguments regarding claims 4 and 23, Metcalfe further discloses that based on 
the stored saliency signal, the images would be reproduced, wherein when 
reproducing, the camera would select particular images based on the degree of 
importance (LOI) as set by the user when recording the images (See pages 5-7; 
page 6, line 31 - page 7, line 8)). By teaching that the images with a high LOI 
would be selected for creating an album or to be printed with high quality further 
teaches that images that do not have a high LOI would be passed or skipped 
since only the images with a high LOI would be displayed in the virtual album. 
Metcalfe as applied reads on the limitations "... picture selection circuitry for 
selectively passing the picture signals in response to the saliency signal ..." since 
the display or skip of images is determined based on the saliency signal (LOI). 

5. In the previous Office Action mailed on April 15, 2008, the limitations "... wherein 
the user control is a remote control for communicating with the electronic camera" 
recited in claims 18 and 36 were rejected taking Official Notice to the limitations. 
Because the Applicant failed to traverse the Examiner's assertion of Official Notice, the 
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well known in the art statement is taken to be admitted prior art. See MPEP § 2144.03 
[R-1](C). 

6. Applicant's arguments, see page 1 1 , lines 5-1 6; page 1 1 , line 24 - page 1 2, line 
16; page 13, line 1 - page 15, line 18, filed July 15, 2008, with respect to the rejections 
of claims 12, 13, 30, 31, 40, 42, 44-48, 50-53, 57 and 59 under 35 USC 102 and 35 
USC 103(a) have been fully considered and are persuasive. Therefore, the rejection 
has been withdrawn. However, upon further consideration, new grounds of rejection 
are made in view of newly found prior art. 

Claim Rejections - 35 USC § 102 

7. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

8. Claims 44-47, 57, and 59 are rejected under 35 U.S.C. 102(b) as being 
anticipated by Takahashi, US 2002/0041757 A1. 

Regarding claim 44, Takahashi discloses an imaging system comprising an 
electronic camera (See figs. 4(a), 4(b), 8, 9(a), 9(b), 1 0, and 1 1 ) for producing an image 
signal, a physically or mechanically operable user control (Takahashi discloses the use 
of buttons 109 to set auxiliary information (which the Examiner is interpreting as the 
saliency information) related to the image data being captured; page 6, H 0106. 
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Takahashi further discloses the use of a pressure sensor 109a and sweat sensor 109b 
to determine the auxiliary information related to the image data (page 6, H 01 1 2 - page 
7, U 01 14) for receiving an input from a user and for generating a first saliency signal 
while the image signal is being produced (Takahashi further discloses that the auxiliary 
information includes information related to the persons (i.e. son, daughter, friend, father, 
mother) (see figs. 23(a) and 23 (b); page 8, 1f 01 1 7 - page 9, U 01 24)) for receiving an 
input from a user and for generating, in response to the input from the user a saliency 
signal (auxiliary information having information such as persons information)), saliency 
circuitry for automatically generating an image related second saliency signal in 
response to the image signal (Takahashi further teaches that the auxiliary information 
includes a degree of importance of said persons appearing in the image data, and that 
said degree of importance can be determined based on the time length of a scene 
where a particular person set by the user appear; see page 8, If 01 19.), and circuitry for 
combining said saliency signals to form a complex saliency signal (Takahashi discloses 
that the auxiliary information has persons information and degree of importance of said 
persons and that the auxiliary information is stored with the image signal and further 
discloses that the camera would also display the auxiliary information on a display 
screen (As shown in figs. 23, the user would set the auxiliary information and the set 
auxiliary information would be displayed in the display as shown in figs. 25 and 26 (see 
persons information and the degree of importance displayed on the display); page 8, U 
01 1 8 - page 9, H 01 24)) (This teaches the combination of the two saliency signals (the 
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persons information and the degree of importance information stored/displayed together 
in association with the image) to create a complex saliency signal as claimed.). 

Regarding claim 45, Takahashi discloses that the operation of at least a part of 
the electronic camera is arranged to be controlled in response to the complex saliency 
signal (Takahashi discloses that the auxiliary information has persons information and 
degree of importance of said persons and that the auxiliary information is stored with 
the image signal and further discloses that the camera would also display the auxiliary 
information on a display screen (As shown in figs. 23, the user would set the auxiliary 
information and the set auxiliary information would be displayed in the display as shown 
in figs. 25 and 26 (see persons information and the degree of importance displayed on 
the display); page 8, H 0118 — page 9, 1f 01 24)) being arranged to be controlled in 
response to the saliency signal (based on the auxiliary information the display would 
display the auxiliary information as shown in figs. 25 and 26). 

Regarding claim 46, Takahashi discloses a separate user operable picture 
taking control for permitting enabling the electronic camera to take pictures (shooting 
button 104 as shown in fig. 4 (b)). 

Regarding claim 47, Takahashi discloses that the first saliency signal can have 
more than two values (As shown in figs. 23 (a) and 23 (b), Takahashi discloses that 
more than one person can be selected (i.e. the son and the daughter); page 8, H 01 19). 

Regarding claim 57, claim 57 recites "... the saliency signal being capable of 
having more than two values". It is noted by the Examiner that the term "capable of is 
non-limiting and therefore has not been given patentable weight during examination of 



Application/Control Number: 10/696,567 Page 10 

Art Unit: 2622 

the claims on their merits. Language that suggests or makes optional but does not 
require steps to be performed or does not limit a claim to a particular structure does not 
limit the scope of a claim or claim limitation. MPEP §21 06. 

The subject matter of a properly construed claim is defined by the terms that limit 
its scope. It is this subject matter that must be examined. As a general matter, the 
grammar and intended meaning of terms used in a claim will dictate whether the 
language limits the claim scope. Language that suggests or makes optional but does 
not require steps to be performed or does not limit a claim to a particular structure does 
not limit the scope of a claim or claim limitation. The following are examples of language 
that may raise a question as to the limiting effect of the language in a claim: 

(A) statements of intended use or field of use, 

(B) "adapted to" or "adapted for" clauses, 

(C) "wherein" clauses, or 

(D) "whereby" clauses. 

This list of examples is not intended to be exhaustive. See also MPEP § 21 1 1 .04. 

USPTO personnel are to give claims their broadest reasonable interpretation in 
light of the supporting disclosure. In re Morris, 127 F.3d 1048, 1054-55, 44 USPQ2d 
1023, 1027-28 (Fed. Cir. 1997). Limitations appearing in the specification but not recited 
in the claim should not be read into the claim. E-Pass Techs., Inc. v. 3Com Corp., 343 
F.3d 1364, 1369, 67 USPQ2d 1947, 1950 (Fed. Cir. 2003) (claims must be interpreted 
"in view of the specification" without importing limitations from the specification into the 
claims unnecessarily). In re Prater, 415 F.2d 1393, 1404-05, 162 USPQ 541, 550- 551 
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(CCPA 1969). See also In re Zletz, 893 F.2d 319, 321-22, 13 USPQ2d 1320, 1322 
(Fed. Cir. 1989) ("During patent examination the pending claims must be interpreted as 
broadly as their terms reasonably allow.... The reason is simply that during patent 
prosecution when claims can be amended, ambiguities should be recognized, scope 
and breadth of language explored, and clarification imposed.... An essential purpose of 
patent examination is to fashion claims that are precise, clear, correct, and 
unambiguous. Only in this way can uncertainties of claim scope be removed, as much 
as possible, during the administrative process"). 

Furthermore, it has been held that the recitation that an element is "capable of 
performing a function is not a positive limitation but only requires the ability to so 
perform. It does not constitute a limitation in any patentable sense. In re Hutchison, 69 
USPQ 138. 

Takahashi discloses an apparatus comprising an electronic camera (See figs. 
4(a), 4(b), 8, 9(a), 9(b), 10, and 11) having a picture taking control (shooting button 104 
as shown in fig. 4 (b)) for selectively activating the electronic camera to derive picture 
signals, the electronic camera further including a user operable control for generating a 
non-playback saliency signal (Takahashi discloses the use of buttons 109 to set 
auxiliary information (which the Examiner is interpreting as the saliency information) 
related to the image data being captured; page 6, U 0106. Takahashi further discloses 
the use of a pressure sensor 109a and sweat sensor 109b to determine the auxiliary 
information related to the image data (page 6, U 01 12 - page 7, If 01 14). Also 
Takahashi discloses that the auxiliary information includes information related to the 
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persons (i.e. son, daughter, friend, father, mother) and a degree of importance of said 
persons appearing in the image data (see figs. 23(a) and 23 (b); page 8,^0117- page 
9, U 0124)), and a memory (Fig. 1:13) arranged for selectively retaining images 
associated with higher saliency levels in said memory in preference to images with 
lower saliency levels (Takahashi further discloses that the images are recorded or 
transmitted based on the importance level of the image, wherein only images with high 
importance level can be recorded in order to reduce the amount of use of the recording 
medium; page 5, If 0094), the saliency signal being capable of having more than two 
values (as shown in figs. 23(a) and 23(b), the persons information and degree of 
importance of the persons in the image can change in value between a plurality of 
values). 

Regarding claim 59, Takahashi further discloses that the electronic camera 
includes the memory (See fig. 1 : 13). Grounds for rejecting claim 57 apply here. 

9. Claims 54 and 56 are rejected under 35 U.S.C. 102(b) as being anticipated 
by Metcalfe, AU 743216 B. 

Regarding claim 54, claim 54 recites "an electronic camera having a picture 
taking control for selectively activating the camera to derive input picture signals, the 
electronic camera further including a user operable control for generating a saliency 
signal capable of having plural values and a buffer for receiving the input picture signals 
and having a capacity for the input picture signals determined in response to the value 
of the saliency signal". It is noted by the Examiner that the term " capable of . It is noted 
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by the Examiner that the term "capable of is non-limiting and therefore has not been 
given patentable weight during examination of the claims on their merits. Language that 
suggests or makes optional but does not require steps to be performed or does not limit 
a claim to a particular structure does not limit the scope of a claim or claim limitation. 
MPEP §2106. 

The subject matter of a properly construed claim is defined by the terms that limit 
its scope. It is this subject matter that must be examined. As a general matter, the 
grammar and intended meaning of terms used in a claim will dictate whether the 
language limits the claim scope. Language that suggests or makes optional but does 
not require steps to be performed or does not limit a claim to a particular structure does 
not limit the scope of a claim or claim limitation. The following are examples of language 
that may raise a question as to the limiting effect of the language in a claim: 

(A) statements of intended use or field of use, 

(B) "adapted to" or "adapted for" clauses, 

(C) "wherein" clauses, or 

(D) "whereby" clauses. 

This list of examples is not intended to be exhaustive. See also MPEP § 21 1 1 .04. 

USPTO personnel are to give claims their broadest reasonable interpretation in 
light of the supporting disclosure. In re Morris, 127 F.3d 1048, 1054-55, 44 USPQ2d 
1023, 1027-28 (Fed. Cir. 1997). Limitations appearing in the specification but not recited 
in the claim should not be read into the claim. E-Pass Techs., Inc. v. 3Com Corp., 343 
F.3d 1364, 1369, 67 USPQ2d 1947, 1950 (Fed. Cir. 2003) (claims must be interpreted 
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"in view of the specification" without importing limitations from the specification into the 
claims unnecessarily). In re Prater, 415 F.2d 1393, 1404-05, 162 USPQ 541, 550- 551 
(CCPA 1969). See also In re Zletz, 893 F.2d 319, 321-22, 13 USPQ2d 1320, 1322 
(Fed. Cir. 1989) ("During patent examination the pending claims must be interpreted as 
broadly as their terms reasonably allow.... The reason is simply that during patent 
prosecution when claims can be amended, ambiguities should be recognized, scope 
and breadth of language explored, and clarification imposed.... An essential purpose of 
patent examination is to fashion claims that are precise, clear, correct, and 
unambiguous. Only in this way can uncertainties of claim scope be removed, as much 
as possible, during the administrative process"). 

Furthermore, it has been held that the recitation that an element is "capable of 
performing a function is not a positive limitation but only requires the ability to so 
perform. It does not constitute a limitation in any patentable sense. In re Hutchison, 69 
USPQ 138. 

Metcalfe discloses an apparatus (See fig. 1) comprising an electronic camera 
(See fig. 1 ) having a picture taking control (button 1 1 1 as shown in fig. 1 ) for selectively 
activating the camera to derive picture signals, the camera further including a user 
operable control (button 1 12 as shown in fig. 1) for generating a non-playback saliency 
signal (the saliency signal generated in Metcalfe is a level of interest signal to indicate 
portion of the image signals that have certain degree of interest to be stored in the 
memory 120 in association with the saliency signal) and picture selection circuitry 
(circuitry is inherent in the Metcalfe reference to control the recording and reproduction 
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of the video signals stored in the memory 120) for selectively passing the picture signals 
in response to the saliency signal (Metcalfe discloses that he user can select a saliency 
signal (LOI) to a particular image being captured, the saliency signal is stored in 
association with the image (See pages 5-7). Metcalfe further discloses that based on 
the stored saliency signal, the images would be reproduced, wherein when reproducing, 
the camera would select particular images based on the degree of importance (LOI) as 
set by the user when recording the images (See pages 5-7; page 6, line 31 - page 7, 
line 8)). By teaching that the images with a high LOI would be selected for creating an 
album or to be printed with high quality further teaches that images that do not have a 
high LOI would be passed or skipped since only the images with a high LOI would be 
displayed in the virtual album. Metcalfe as applied reads on the limitations "... picture 
selection circuitry for selectively passing the picture signals in response to the saliency 
signal ..." since the display or skip of images is determined based on the saliency signal 
(LOI)), the saliency signal being capable of having more than two values (As discussed 
by Metcalfe , the operation of the button 112 would automatically generate a plurality of 
saliency signals, wherein when operating the button 1 12, if the button is set to be 
controlled by pressing it a plurality of times, it would represent creating a first plurality of 
saliency signals that would generate the plurality of saliency signals to be associated to 
the image signal when recording into the memory 120) (See page 4, line 5 - page 5, 
line 23; page 6, line 23 - page 7, line 8). 

Regarding claim 56, limitations have been discussed and analyzed in claim 54. 
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Claim Rejections - 35 USC § 103 

1 0. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

11. Claims 1, 3-5, 10-21, 23-25, 28-38, 40, 42 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over Metcalfe, AU 743216 B in view of Takahashi, US 
2002/0041757 A1. 

Regarding claim 1 , claim 1 recites "... a saliency signal that (a) can change in 
value between at least three different discrete values while the image signal is being 
produced, or (b) can have values that are continuously variable while the image signal 
is being produced". It is noted by the Examiner that the term " can " is non-limiting and 
therefore has not been given patentable weight during examination of the claims on 
their merits. Language that suggests or makes optional but does not require steps to be 
performed or does not limit a claim to a particular structure does not limit the scope of a 
claim or claim limitation. MPEP §2106. 

The subject matter of a properly construed claim is defined by the terms that limit its 
scope. It is this subject matter that must be examined. As a general matter, the 
grammar and intended meaning of terms used in a claim will dictate whether the 
language limits the claim scope. Language that suggests or makes optional but does 
not require steps to be performed or does not limit a claim to a particular structure does 



Application/Control Number: 10/696,567 Page 17 

Art Unit: 2622 

not limit the scope of a claim or claim limitation. The following are examples of language 
that may raise a question as to the limiting effect of the language in a claim: 

(A) statements of intended use or field of use, 

(B) "adapted to" or "adapted for" clauses, 

(C) "wherein" clauses, or 

(D) "whereby" clauses. 

This list of examples is not intended to be exhaustive. See also MPEP § 21 1 1 .04. 
USPTO personnel are to give claims their broadest reasonable interpretation in light of 
the supporting disclosure. In re Morris, 127 F.3d 1048, 1054-55, 44 USPQ2d 1023, 
1027-28 (Fed. Cir. 1997). Limitations appearing in the specification but not recited in the 
claim should not be read into the claim. E-Pass Techs., Inc. v. 3Com Corp., 343 F.3d 
1364, 1369, 67 USPQ2d 1947, 1950 (Fed. Cir. 2003) (claims must be interpreted "in 
view of the specification" without importing limitations from the specification into the 
claims unnecessarily). In re Prater, 415 F.2d 1393, 1404-05, 162 USPQ 541, 550- 551 
(CCPA 1969). See also In re Zletz, 893 F.2d 319, 321-22, 13 USPQ2d 1320, 1322 
(Fed. Cir. 1989) ("During patent examination the pending claims must be interpreted as 
broadly as their terms reasonably allow.... The reason is simply that during patent 
prosecution when claims can be amended, ambiguities should be recognized, scope 
and breadth of language explored, and clarification imposed.... An essential purpose of 
patent examination is to fashion claims that are precise, clear, correct, and 
unambiguous. Only in this way can uncertainties of claim scope be removed, as much 
as possible, during the administrative process."). 
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Metcalfe discloses a camera apparatus (See fig. 1) comprising an electronic 
camera (See fig. 1) for producing an image signal, a user operable picture taking control 
(111 as shown in fig. 1 ) for selectively activating the electronic camera to take pictures, 
and an additional physically or mechanically operable user control (1 12 as shown in fig. 
1 , note that the limitations "an additional physically or mechanically operable user 
control" are written as optional elements by using the word "or") for receiving an input 
from a user and for generating, in response to the input from the user a saliency signal 
(Metcalfe discloses generating a level of interest (LOI) set by the user when using 
button 112) that (a) can change in value between at least three different discrete values 
while the image signal is being produced (Metcalfe discloses assigning a level of 
interest to the image data being recorded, wherein the user can variably assign a 
plurality of level of interest through the capture of the a video sequence; see Fig. 3. 
This teaches generating a saliency signal that can change in value between at least 
three different discrete values while the image signal is being produced), or (b) can 
have values that are continuously variable while the image signal is being produced 
(Metcalfe discloses assigning a level of interest to the image data being recorded, 
wherein the user can variably assign a plurality of level of interest through the capture of 
the a video sequence; see Fig. 3. This teaches generating a saliency signal that can 
have values that are continuously variable while the image signal is being produced), 
and a memory (120 as shown in fig. 1) arranged for storing the image signal and the 
saliency signal (page 4, lines 5-13; page 5, lines 4-35), operation of at least a part of the 
camera apparatus while the electronic camera is activated to take pictures (Metcalfe 
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discloses setting the LOI while the camera is activated to take pictures, and storing said 
LOI associated with the images so that said LOI can be used to control the reproduction 
of the images (i.e. printing, creating thumbnail files for photo albums, etc.)) being 
arranged to be controlled in response to the saliency signal (as discussed in page 6, 
line 31 - page 7, line 8 , Metcalfe discloses that the saliency signal (LOI) can be used to 
control the reproduction of the images (i.e. printing, creating thumbnail files for photo 
albums, etc.)) (See page 4, line 5 - page 5, line 23; page 6, line 23 - page 7, line 8). 

Metcalfe does not explicitly disclose that the operation is in response to the 
saliency signal is in addition to recording the saliency signal in the memory. 

However, Takahashi discloses an electronic camera (See figs. 4(a), 4(b), 8, 9(a), 
9(b), 10, and 11) producing image signal, comprising a user operable picture taking 
control (shooting button 104 as shown in fig. 4 (b)) for selectively activating the 
electronic camera to take pictures, and an additional operable user control (Takahashi 
discloses the use of buttons 109 to set auxiliary information (which the Examiner is 
interpreting as the saliency information) related to the image data being captured; page 
6, U 01 06. Takahashi further discloses the use of a pressure sensor 1 09a and sweat 
sensor 109b to determine the auxiliary information related to the image data (page 6, H 
01 12 - page 7, ^ 01 14). Also Takahashi discloses that the auxiliary information 
includes information related to the persons (i.e. son, daughter, friend, father, mother) 
and a degree of importance of said persons appearing in the image data (see figs. 23(a) 
and 23 (b); page 8, U 01 17 - page 9, U 0124)) for receiving an input from a user and for 
generating, in response to the input from the user a saliency signal (auxiliary information 
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having information such as persons information and degree of importance of the 
persons in the image) that (a) can change in value between at least three different 
discrete values while the image signal is being produced (as shown in figs. 23(a) and 
23(b), the persons information and degree of importance of the persons in the image 
can change in value between a plurality of values (i.e. three or more values as 
claimed)), or (b) can have values that are continuously variable while the image signal is 
being produced (the auxiliary information can be changed during the capture of the 
image signal), and a memory (13) arranged for storing the image signal and the 
saliency signal (Takahashi further teaches storing the auxiliary information in the header 
of the scene; page 8, 0123 - page 9, 0126), operation of at least a part of the 
camera apparatus while the electronic camera is activated to take pictures (Takahashi 
discloses recording the auxiliary information and further discloses that the camera 
would also display the auxiliary information on a display screen (As shown in figs. 23, 
the user would set the auxiliary information and the set auxiliary information would be 
displayed in the display as shown in figs. 25 and 26; page 8, U 01 18 - page 9, If 0124)) 
being arranged to be controlled in response to the saliency signal (based on the 
auxiliary information the display would display the auxiliary information as shown in figs. 
25 and 26), the operation in response to the saliency signal is in addition to recording 
the saliency signal in the memory (The Examiner is interpreting displaying the auxiliary 
information using the display of the camera as the operation that is in addition to 
recording the saliency signal in the memory as claimed). Displaying the auxiliary 
information while capturing the image data is advantageous because it would provide 
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the user with a user friendly interface that would allow changing the degree of 
importance of the images being captured and would also allow the user to be aware of 
the information being added to the image data. 

Therefore, taking the combined teaching of Metcalfe in view of Takahashi as a 
whole, it would have been obvious to one of an ordinary skill in the art at the time the 
invention was made to apply the concept of having the camera further displaying the 
salient signal being assign to the image data as taught in Takahashi to modify the 
teaching of Metcalfe to perform an operation in response to the saliency signal in 
addition to recording the saliency signal in the memory. The motivation to do so would 
have been to provide the user with a user friendly interface that would allow changing 
the degree of importance of the images being captured and would also allow the user to 
be aware of the information being added to the image data. 

Regarding claim 3, the combined teaching of Metcalfe in view of Takahashi as 
discussed and analyzed in claim 1 further teaches that wherein said part includes a 
buffer for receiving said image signal, the buffer having a capacity arranged to be 
controlled by the value of the saliency signal during operation of the camera apparatus 
(In a further embodiment, Takahashi discloses the concept of determining the amount of 
data to be transmitted based on the cost of transmission service; wherein the allowed 
length of data (L) is determined and compared to the amount of data to be transmitted, 
if the amount of data to be transmitted the apparatus would select video section with a 
priority higher than a threshold value. If after selecting those video with the priority 
higher than a threshold, the length of data still more than the allowed length, the 
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apparatus would increase the priority threshold, however, if the length is less that the 
allowed length, the video signals are transmitted (Page 12, If 0151-0154). By teaching 
adjusting the amount of data to be transmitted based on the length allowed for 
transmission and also based on the priority of the video signals to be transmitted, 
Takahashi inherently discloses "a buffer for receiving said image signal, the buffer 
having a capacity arranged to be controlled by the value of the saliency signal during 
operation of the camera apparatus" as claimed since the amount being adjusted in the 
apparatus needs to be in a particular buffer or memory prior to transmission in order to 
properly select the video signals with higher priority). One of an ordinary skill in the art 
would have found obvious to apply the concepts of adjusting the amount of data to be 
transmitted based on the priority set to the video signals to further modify the camera 
apparatus to have a buffer for receiving said image signal, the buffer having a capacity 
arranged to be controlled by the value of the saliency signal during operation of the 
camera apparatus with the motivation of select as many as possible the most important 
video signals from the video data for transmission as suggested by Takahashi (Page 
12,H0154). 

Regarding claim 4, the combined teaching of Metcalfe in view of Takahashi as 
discussed and analyzed in claim 1 further teaches that the part includes image selection 
circuitry for receiving the saliency and image signals and for selectively passing ones of 
said image signals as determined by said saliency signal (As taught in Metcalfe, the 
camera receives the saliency signal (LOI) and based on said saliency signal, when 
reproducing, the camera would select particular images based on the degree of 
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importance as set by the user when recording the images. By teaching that the images 
with a high LOI would be selected for creating an album or to be printed with high 
quality further teaches that images that do not have a high LOI would be passed or 
skipped since only the images with a high LOI would be displayed in the virtual album. 
Metcalfe as applied reads on "... said part includes image selection circuitry for 
receiving the saliency and image signals and for selectively passing ones of said image 
signals as determined by said saliency signaf as written since the display or skip of 
images is determined based on the LOI set. (See pages 5-7, specifically page 6, line 31 
- page 7, line 8)). 

Regarding claim 5, the combined teaching of Metcalfe in view of Takahashi as 
discussed and analyzed in claim 1 further teaches that said part comprises the memory 
(memory 13 in Takahashi), the memory including management circuitry arranged to be 
responsive to the saliency signal for selectively retaining in said memory images 
associated with higher saliency levels in preference to images with lower saliency levels 
(Takahashi further discloses that the images are recorded or transmitted based on the 
importance level of the image, wherein only images with high importance level can be 
recorded in order to reduce the amount of use of the recording medium; page 5, H 
0094). 

Regarding claim 10, the combined teaching of Metcalfe in view of Takahashi as 
discussed and analyzed in claim 1 further teaches a user operable control for picture 
taking control of the electronic camera (Metcalfe, 111 as shown in fig. 1). 
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Regarding claim 11, Metcalfe discloses that the user control includes a normal 
picture taking control on the electronic camera (111 as shown in fig. 1). 

Regarding claim 12, the combined teaching of Metcalfe in view of Takahashi as 
discussed and analyzed in claim 1 further teaches at least one further physically or 
mechanically operable user control for generating a corresponding related saliency 
signal (As shown in Takahashi, figs. 4(b): 109; fig. 9(a): 109, 10: 109a, and 11: 109b, 
Takahashi discloses the use of a plurality of buttons to select from different auxiliary 
information to be assigned to the video signal (note that the buttons 109 are physically 
located on the camera). Furthermore, as shown in figs 23(a) and 23(b), Takahashi 
further discloses that the auxiliary information can be selected using a monitor, wherein 
the user can select the person information and the degree of importance of the persons 
using buttons 103m, 103n, 101m and 101n; page 8, If 0119 (although these buttons are 
displayed on the touch screen display, the Examiner understands that the buttons are 
physically located on the camera since they have different physical location on said 
display)). Grounds for rejecting claim 1 apply here. 

Regarding claim 13, the combined teaching of Metcalfe in view of Takahashi as 
discussed and analyzed in claims 1 and 12 further teaches saliency circuitry for 
combining said saliency signals to form a complex saliency signal (the Examiner is 
reading the complex saliency signal as the combined information having the persons 
information and the degree of importance information as shown in Takahashi), the 
complex saliency signal being the saliency signal for controlling at least a part (The 
Examiner is reading the part as the display of the camera in Takahashi as discussed in 
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claim 1) of the electronic camera and the saliency signal the memory is arranged to 
store (As discussed in claim 1, Takahashi discloses that the auxiliary information has 
persons information and degree of importance of said persons and that the auxiliary 
information is stored with the image signal and further discloses that the camera would 
also display the auxiliary information on a display screen (As shown in figs. 23, the user 
would set the auxiliary information and the set auxiliary information would be displayed 
in the display as shown in figs. 25 and 26 (see persons information and the degree of 
importance displayed on the display); page 8, 0118 - page 9, U 0124)) being arranged 
to be controlled in response to the saliency signal (based on the auxiliary information 
the display would display the auxiliary information as shown in figs. 25 and 26). 
Grounds for rejecting claim 1 and 12 apply here. 

Regarding claim 14, Metcalfe discloses a saliency circuitry for generating an 
image related saliency signal in response to said image signal (Metcalfe discloses 
controlling the reproduction operation of the camera based on the associated saliency 
signal to the image signal so that when reproducing the image signal with higher 
importance would be displayed differently from the other image signal. See page 4, line 
5 - page 5, line 23; page 6, line 23 - page 7, line 8. Takahashi further discloses 
reproducing the video based on the importance level of the image, wherein only images 
with high importance level can be reproduced so that the user can enjoy the recorded 
work without feeling tired, and the power consumption is reduced to secure more driving 
time; page 10, H 01 31). 

Regarding claim 15, limitations have been discussed and analyzed in claim 13. 
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Regarding claim 16, Metcalfe discloses circuitry for incorporating said saliency 
signal in each of said image signals (Metcalfe discloses incorporating said saliency 
signal (LOI) to each of the frames in the image signal. See page 4, line 5 - page 5, line 
23; page 6, line 23 - page 7, line 8). 

Regarding claim 17, the combined teaching of Metcalfe in view of Takahashi as 
discussed and analyzed in claims 1 teaches that the user control is part of the camera 
or is physically attached to the camera body (See Metcalfe, controls in Fig. 1 ; see also 
Takahashi buttons 109 as shown in figs. 4(b), 9(b), 10 and 11, and buttons 103m, 103n, 
101m, 101 n as shown in figs. 23(a) and 23(b)). 

Regarding claim 18, he combined teaching of Metcalfe in view of Takahashi 
fails to teach that the user control is a remote control for communication with the 
camera. However, the Examiner takes Official Notice that the concept of controlling a 
camera with a remote control is well known in the art at the time the invention was made 
and that it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to have made the user control of Metcalfe and Takahashi a remote 
control as opposed to a camera-body integrated control. One would have been 
motivated to do so because it is well known in the art that by using a remote control to 
control some elements of a camera, the user does not have to be near the camera to 
send and receive desired signals from the camera. This is particularly advantageous in 
cases where plural cameras are used or cameras are placed out of the reach of the 
user (e.g. surveillance cameras), where the remote control would allow the user to send 
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signals to the camera(s) from a separate location, thereby simplifying camera control for 
the user. 

Regarding claim 19, Metcalfe discloses that the user control comprises a 
physically movable control member (pressure button that assign a level of interest of an 
image signal based on the pressure applied to said button) and a sensor arranged to be 
responsive to movement of the control member (See page 4, line 27 - page 5, line 4). 
By teaching a pressure button that assigns a LOI of an image signal based on the 
pressure applied to the button, Metcalfe discloses a physically movable control member 
(in this case the pressure button as discussed in Metcalfe) and a sensor arranged to be 
responsive to movement of the control member since by teaching that the LOI is 
assigned based on the pressure applied to the button, the use of a sensor to determine 
the applied pressure in order to assigned the LOI of an image is inherent and 
necessitated in Metcalfe. 

Regarding claim 20, the Examiner notes that the limitations "the user control 
comprises a pressure or force sensing transducer for deriving the saliency signal that 
can have values that are continuously variable", the elements "pressure" or "force 
sensing transducer" are written as optional elements by using the word "or". 

Metcalfe discloses that the user control comprises a pressure or force sensing 
transducer for deriving the saliency signal that can have values that are continuously 
variable (Metcalfe as applied to claim 19, teaches the use of pressure (pressure button 
that assign a level of interest of an image signal based on the pressure applied to said 
button; page 4, line 27 - page 5, line 4) for deriving the saliency signal. By teaching 
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that Metcalfe discloses the use of pressure applied to the button, Metcalfe discloses the 
use of pressure for deriving the saliency signal as claimed. 

Regarding claim 21, limitations have been discussed and analyzed in claim 1 . 

Regarding claim 23, limitations have been discussed and analyzed in claim 4. 

Regarding claim 24, limitations have been discussed and analyzed in claim 3. 

Regarding claim 25, limitations have been discussed and analyzed in claim 5. 

Regarding claim 28, limitations have been discussed and analyzed in claim 10. 

Regarding claim 29, limitations have been discussed and analyzed in claim 11. 

Regarding claim 30, limitations have been discussed and analyzed in claim 12. 

Regarding claim 31, limitations have been discussed and analyzed in claim 13. 

Regarding claim 32, limitations have been discussed and analyzed in claim 13. 

Regarding claim 33, limitations have been discussed and analyzed in claim 13. 

Regarding claim 34, limitations have been discussed and analyzed in claim 16. 

Regarding claim 35, limitations have been discussed and analyzed in claim 17. 

Regarding claim 36, limitations have been discussed and analyzed in claim 18. 

Regarding claim 37, limitations have been discussed and analyzed in claim 19. 

Regarding claim 38, limitations have been discussed and analyzed in claims 19 
and 20. 

Regarding claim 40, claim 1 recites "... one of the saliency signals being a 
signal that (a) can change in value between at least three different discrete values while 
the image signal is being produced, or (b) can have values that are continuously 
variable while the image signal is being produced". It is noted by the Examiner that the 
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term " can " is non-limiting and therefore has not been given patentable weight during 
examination of the claims on their merits. Language that suggests or makes optional 
but does not require steps to be performed or does not limit a claim to a particular 
structure does not limit the scope of a claim or claim limitation. MPEP §21 06. 
The subject matter of a properly construed claim is defined by the terms that limit its 
scope. It is this subject matter that must be examined. As a general matter, the 
grammar and intended meaning of terms used in a claim will dictate whether the 
language limits the claim scope. Language that suggests or makes optional but does 
not require steps to be performed or does not limit a claim to a particular structure does 
not limit the scope of a claim or claim limitation. The following are examples of language 
that may raise a question as to the limiting effect of the language in a claim: 

(A) statements of intended use or field of use, 

(B) "adapted to" or "adapted for" clauses, 

(C) "wherein" clauses, or 

(D) "whereby" clauses. 

This list of examples is not intended to be exhaustive. See also MPEP § 21 1 1 .04. 
USPTO personnel are to give claims their broadest reasonable interpretation in light of 
the supporting disclosure. In re Morris, 127 F.3d 1048, 1054-55, 44 USPQ2d 1023, 
1027-28 (Fed. Cir. 1997). Limitations appearing in the specification but not recited in the 
claim should not be read into the claim. E-Pass Techs., Inc. v. 3Com Corp., 343 F.3d 
1364, 1369, 67 USPQ2d 1947, 1950 (Fed. Cir. 2003) (claims must be interpreted "in 
view of the specification" without importing limitations from the specification into the 
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claims unnecessarily). In re Prater, 415 F.2d 1393, 1404-05, 162 USPQ 541, 550- 551 
(CCPA 1969). See also In re Zletz, 893 F.2d 319, 321-22, 13 USPQ2d 1320, 1322 
(Fed. Cir. 1989) ("During patent examination the pending claims must be interpreted as 
broadly as their terms reasonably allow.... The reason is simply that during patent 
prosecution when claims can be amended, ambiguities should be recognized, scope 
and breadth of language explored, and clarification imposed.... An essential purpose of 
patent examination is to fashion claims that are precise, clear, correct, and 
unambiguous. Only in this way can uncertainties of claim scope be removed, as much 
as possible, during the administrative process."). 

Metcalfe discloses an imaging system (See fig. 1) comprising an electronic 
camera (See fig. 1) for producing an image signal, physically or mechanically operable 
user controls (See user controls 106, 104, 111, 112, 110 and 108 as shown in fig. 1), 
the user control being arranged for receiving an input from a user and for generating 
first saliency signal (Metcalfe discloses the use of button 1 12 to generate a plurality of 
saliency signals (Level of interest signals "LOI") to be associated to the image signal 
being recorded with the camera) while the image signal is being produced, and saliency 
circuitry (the camera in Metcalfe inherently has a saliency signal circuitry to generate 
the saliency signal upon operation of the camera button 1 1 2) for storing said first 
saliency signal (Metcalfe discloses recording the plurality of saliency signals in a 
memory (tape 120 in fig. 1) in association with the image data; see page 4, line 5 - 
page 5, line 23; page 6, line 23 - page 7, line 8), the saliency signal being, a signal that 
(a) can change in value between at least three different discrete values while the image 
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signal is being produced (Metcalfe discloses assigning a level of interest to the image 
data being recorded, wherein the user can variably assign a plurality of level of interest 
through the capture of the a video sequence; see Fig. 3. This teaches generating a 
saliency signal that can change in value between at least three different discrete values 
while the image signal is being produced), or (b) can have values that are continuously 
variable while the image signal is being produced (Metcalfe discloses assigning a level 
of interest to the image data being recorded, wherein the user can variably assign a 
plurality of level of interest through the capture of the a video sequence; see Fig. 3. 
This teaches generating a saliency signal that can have values that are continuously 
variable while the image signal is being produced), a memory (120 as shown in fig. 1) 
arranged for storing the image signal and the saliency signal in response to the saliency 
signal (page 4, lines 5-1 3; page 5, lines 4-35), operation of at least part of the electronic 
camera being arranged to be controlled in response to the saliency signal (as discussed 
in page 6, line 31 - page 7, line 8, Metcalfe discloses that the saliency signal (LOI signal 
stored in memory 120) can be used to control the reproduction of the images (i.e. 
printing, creating thumbnail files for photo albums, etc.)) (See page 4, line 5 - page 5, 
line 23; page 6, line 23 - page 7, line 8). 

Metcalfe does not explicitly disclose at least two physically or mechanically 
operable user controls, each of the user controls for generating first and second 
saliency signals; that said saliency circuitry combines said first and second saliency 
signals to form a complex saliency signal; that the operation of at least part of the 
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electronic camera being arranged to be controlled in response to the complex saliency 
signal. 

However, Takahashi discloses an electronic camera (See figs. 4(a), 4(b), 8, 9(a), 
9(b), 10, and 11) producing image signal, comprising a user operable picture taking 
control (shooting button 104) for selectively activating the electronic camera to take 
pictures, and at least two physically or mechanically operable user controls (As shown 
in Takahashi, figs. 4(b): 109; fig. 9(a): 109, 10: 109a, and 11: 109b, Takahashi discloses 
the use of a plurality of buttons to select from different auxiliary information (which the 
Examiner is interpreting as the saliency information) to be assigned to the video signal 
(note that the buttons 109 are physically located on the camera). Furthermore, as 
shown in figs 23(a) and 23(b), Takahashi further discloses that the auxiliary information 
can be selected using a monitor, wherein the user can select the person information 
and the degree of importance of the persons using buttons 103m, 103n, 101m and 
101n; page 8, If 01 19 (although these buttons are displayed on the touch screen 
display, the Examiner understands that the buttons are physically located on the 
camera since they have different physical location on said display)). Takahashi further 
discloses the use of a pressure sensor 109a and sweat sensor 109b to determine the 
auxiliary information related to the image data (page 6, U 01 1 2 - page 7,^011 4). Also 
Takahashi discloses that the auxiliary information includes information related to the 
persons (i.e. son, daughter, friend, father, mother) and a degree of importance of said 
persons appearing in the image data (see figs. 23(a) and 23 (b); page 8,^0117- page 
9, U 0124)) for receiving an input from a user and for generating, in response to the 
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input from the user a saliency signal (auxiliary information having information such as 
persons information and degree of importance of the persons in the image) that (a) can 
change in value between at least three different discrete values while the image signal 
is being produced (as shown in figs. 23(a) and 23(b), the persons information and 
degree of importance of the persons in the image can change in value between a 
plurality of values (i.e. three or more values as claimed)), or (b) can have values that are 
continuously variable while the image signal is being produced (the auxiliary information 
can be changed during the capture of the image signal), and saliency circuitry for 
combining said saliency signals to form a complex saliency signal (the Examiner is 
reading the complex saliency signal as the combined information having the persons 
information and the degree of importance information as shown in Takahashi), the 
complex saliency signal being the saliency signal for controlling at least a part (The 
Examiner is reading the part as the display of the camera in Takahashi as discussed in 
claim 1) of the electronic camera and the saliency signal the memory is arranged to 
store (As discussed in claim 1, Takahashi discloses that the auxiliary information has 
persons information and degree of importance of said persons and that the auxiliary 
information is stored with the image signal and further discloses that the camera would 
also display the auxiliary information on a display screen (As shown in figs. 23, the user 
would set the auxiliary information and the set auxiliary information would be displayed 
in the display as shown in figs. 25 and 26 (see persons information and the degree of 
importance displayed on the display which the examiner is reading as the complex 
saliency signal generated) (This teaches performing an operation ); page 8, If 01 18 - 
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page 9, H 0124)) being arranged to be controlled in response to the saliency signal 
(based on the auxiliary information the display would display the auxiliary information as 
shown in figs. 25 and 26). Therefore Takahashi discloses at least two physically or 
mechanically operable user controls, each of the user controls for generating first and 
second saliency signals; that said saliency circuitry combines said first and second 
saliency signals to form a complex saliency signal; that the operation of at least part of 
the electronic camera being arranged to be controlled in response to the complex 
saliency signal as claimed. Having a plurality of operation controls to generate different 
saliency signals to be combined into a single complex saliency signal to control the 
display operation of the camera is advantageous because it would provide the user with 
a user friendly interface that would allow changing the degree of importance of the 
images being captured and would also allow the user to be aware of the information 
being added to the image data. 

Therefore, taking the combined teaching of Metcalfe in view of Takahashi as a 
whole, it would have been obvious to one of an ordinary skill in the art at the time the 
invention was made to apply the concept of having the camera with a plurality of 
operation controls to generate different saliency signals to be combined to control the 
operation of the display to further displaying the combined saliency signal being assign 
to the image data as taught in Takahashi to modify the teaching of Metcalfe to have at 
least two physically or mechanically operable user controls, each of the user controls for 
generating first and second saliency signals; that said saliency circuitry combines said 
first and second saliency signals to form a complex saliency signal; that the operation of 
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at least part of the electronic camera being arranged to be controlled in response to the 
complex saliency signal. The motivation to do so would have been to provide the user 
with a user friendly interface that would allow changing the degree of importance of the 
images being captured and would also allow the user to be aware of the information 
being added to the image data. 

Regarding claim 42, Metcalfe discloses a separate user operable picture taking 
control for selectively activating the electronic camera to take pictures (See button 1 1 1 
as shown in fig. 1). 

12. Claims 2, 7, and 22 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Metcalfe, AU 743216 B in view of Takahashi, US 2002/0041757 
A1 and further in view of Matsumoto et al., US Patent 6,795,642 B2. 

Regarding claim 2, although Takahashi teaches that a compression circuitry 
(See Takahashi, fig. 1: 15; page 5, If 0097; page 6, U 0105) for receiving the image 
signals and for compressing the image signals and that although the invention is 
described on the premise that a shot picture is recorded, a shot picture is not 
necessarily recorded, and it can be used also when compressed video and audio data 
are transmitted as they are to be used on a network or the like (page 10, H 0130), the 
combined teaching of Metcalfe in view of Takahashi fails to teach compressing the 
image signals to an extent determined by the saliency signal. 

However, Matsumoto et al. teaches the concept of having a video recording 
apparatus (Fig. 2) of a surveillance system, recording video data captured by an 
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electronic camera (See fig. 1), wherein when an alarm is activated, the importance of 
the video is determined to be high as compared to when the alarm is not activated (Col. 
3, lines 46-67). Matsumoto et al. further discloses that based on the degree of 
importance given to the video signal, the data compression is also adjusted (i.e. if the 
importance degree of the video is low, it would be compressed at high level and if the 
importance degree of the video is high, said video would be compressed at low level) 
(Col. 3, line 1 5 - col. 4, lines 1 9). Matsumoto also discloses that the importance level 
can also be adjusted by the user operating the surveillance system (Col. 7, lines 22-34). 
Matsumoto et al. further discloses that by adjusting the compression of the video being 
captured, it is possible to record the monitoring image data having a high degree of 
importance as much as possible (Col. 7, lines 35-43). 

Therefore, taking the combined teaching of Metcalfe in view of Takahashi and 
further in view of Matsumoto et al. as a whole, it would have been obvious to one of 
ordinary skill in the art a the time the invention was made to apply the concept of 
adjusting the compression of a video captured by an electronic camera based on a 
degree of importance assign to the video as discussed in Matsumoto et al. to modify the 
teaching of Metcalfe and Takahashi by compressing the image signals to an extent 
determined by the saliency signal. The motivation to do so would have been to record 
the monitoring image data having a high degree of importance as much as possible as 
suggested in Matsumoto et al. 

Regarding claim 7, the combined teaching of Metcalfe in view of Takahashi as 
discussed and analyzed in claims 1 and 2 further teaches that said part comprises the 
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memory (memory 13 in Takahashi), including management circuitry arranged to be 
responsive to the saliency signal for selectively retaining in said memory images 
associated with higher saliency levels in preference to images with lower saliency levels 
(Takahashi further discloses that the images are recorded or transmitted based on the 
importance level of the image, wherein only images with high importance level can be 
recorded in order to reduce the amount of use of the recording medium; page 5, If 
0094). 

Regarding claim 22, limitations have been discussed and analyzed in claim 2. 

13. Claims 48 and 50 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takahashi, US 2002/0041757 A1 in view of Matsumoto et al., US Patent 
6,795,642 B2. 

Regarding claim 48, claim 48 recites "... the saliency signal being capable of 
having more than two values". It is noted by the Examiner that the term " capable of is 
non-limiting and therefore has not been given patentable weight during examination of 
the claims on their merits. Language that suggests or makes optional but does not 
require steps to be performed or does not limit a claim to a particular structure does not 
limit the scope of a claim or claim limitation. MPEP §21 06. 

The subject matter of a properly construed claim is defined by the terms that limit 
its scope. It is this subject matter that must be examined. As a general matter, the 
grammar and intended meaning of terms used in a claim will dictate whether the 
language limits the claim scope. Language that suggests or makes optional but does 
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not require steps to be performed or does not limit a claim to a particular structure does 
not limit the scope of a claim or claim limitation. The following are examples of language 
that may raise a question as to the limiting effect of the language in a claim: 

(A) statements of intended use or field of use, 

(B) "adapted to" or "adapted for" clauses, 

(C) "wherein" clauses, or 

(D) "whereby" clauses. 

This list of examples is not intended to be exhaustive. See also MPEP § 21 1 1 .04. 

USPTO personnel are to give claims their broadest reasonable interpretation in 
light of the supporting disclosure. In re Morris, 127 F.3d 1048, 1054-55, 44 USPQ2d 
1023, 1027-28 (Fed. Cir. 1997). Limitations appearing in the specification but not recited 
in the claim should not be read into the claim. E-Pass Techs., Inc. v. 3Com Corp., 343 
F.3d 1364, 1369, 67 USPQ2d 1947, 1950 (Fed. Cir. 2003) (claims must be interpreted 
"in view of the specification" without importing limitations from the specification into the 
claims unnecessarily). In re Prater, 415 F.2d 1393, 1404-05, 162 USPQ 541, 550- 551 
(CCPA 1969). See also In re Zletz, 893 F.2d 319, 321-22, 13 USPQ2d 1320, 1322 
(Fed. Cir. 1989) ("During patent examination the pending claims must be interpreted as 
broadly as their terms reasonably allow.... The reason is simply that during patent 
prosecution when claims can be amended, ambiguities should be recognized, scope 
and breadth of language explored, and clarification imposed.... An essential purpose of 
patent examination is to fashion claims that are precise, clear, correct, and 
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unambiguous. Only in this way can uncertainties of claim scope be removed, as much 
as possible, during the administrative process.") 

Furthermore, it has been held that the recitation that an element is "capable of 
performing a function is not a positive limitation but only requires the ability to so 
perform. It does not constitute a limitation in any patentable sense. In re Hutchison, 69 
USPQ 138. 

Takahashi discloses an apparatus comprising an electronic camera (See figs. 
4(a), 4(b), 8, 9(a), 9(b), 10, and 11) having a picture taking control (shooting button 104 
as shown in fig. 4 (b)) for selectively activating the electronic camera to derive picture 
signals, the electronic camera further including a user operable control for generating a 
saliency signal (Takahashi discloses the use of buttons 109 to set auxiliary information 
(which the Examiner is interpreting as the saliency information) related to the image 
data being captured; page 6, |f 0106. Takahashi further discloses the use of a pressure 
sensor 109a and sweat sensor 109b to determine the auxiliary information related to the 
image data (page 6, U 01 1 2 - page 7, ^ 01 14). Also Takahashi discloses that the 
auxiliary information includes information related to the persons (i.e. son, daughter, 
friend, father, mother) and a degree of importance of said persons appearing in the 
image data (see figs. 23(a) and 23 (b); page 8, H 01 17 - page 9, U 0124)) 
contemporaneously with the derivation of the picture signals (Takahashi discloses 
generating the auxiliary information (which the Examiner is reading as the saliency 
signal) during capture of the video signal; page 6, U 01 1 1 - page 8, If 01 22), and 
compression circuitry (Fig. 1:15) for compressing the picture signals, the saliency signal 
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being capable of having more than two values (as shown in figs. 23(a) and 23(b), the 
persons information and degree of importance of the persons in the image can change 
in value between a plurality of values (i.e. more than two values as claimed)). 

Takahashi does not explicitly disclose that said compression circuitry compress 
the picture signals to an extent determined by the saliency signal. 

However, Matsumoto et al. teaches the concept of having a video recording 
apparatus (Fig. 2) of a surveillance system, recording video data captured by an 
electronic camera (See fig. 1), wherein when an alarm is activated, the importance of 
the video is determined to be high as compared to when the alarm is not activated (Col. 
3, lines 46-67). Matsumoto et al. further discloses that based on the degree of 
importance given to the video signal, the data compression is also adjusted (i.e. if the 
importance degree of the video is low, it would be compressed at high level and if the 
importance degree of the video is high, said video would be compressed at low level) 
(Col. 3, line 1 5 - col. 4, lines 1 9). Matsumoto also discloses that the importance level 
can also be adjusted by the user operating the surveillance system (Col. 7, lines 22-34). 
Matsumoto et al. further discloses that by adjusting the compression of the video being 
captured, it is possible to record the monitoring image data having a high degree of 
importance as much as possible (Col. 7, lines 35-43). 

Therefore, taking the combined teaching of Takahashi in view of Matsumoto et 
al. as a whole, it would have been obvious to one of ordinary skill in the art a the time 
the invention was made to apply the concept of adjusting the compression of a video 
captured by an electronic camera based on a degree of importance assign to the video 
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as discussed in Matsumoto et al. to modify the compression circuitry in of Takahashi to 
compress the image signals to an extent determined by the saliency signal. The 
motivation to do so would have been to record the monitoring image data having a high 
degree of importance as much as possible as suggested in Matsumoto et al. 

Regarding claim 50, the combined teaching of Takahashi in view of Matsumoto 
et al. as discussed and analyzed in claim 48 further discloses that the electronic camera 
includes the circuitry (See Takahashi, fig. 1: 15). Grounds for rejecting claim 48 apply 
here. 

14. Claims 51-53 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takahashi, US 2002/0041757 A1. 

Regarding claim 51, claim 51 recites "an electronic camera having a picture 
taking control for selectively activating the camera to derive input picture signals, the 
electronic camera further including a user operable control for generating a saliency 
signal capable of having plural values and a buffer for receiving the input picture signals 
and having a capacity for the input picture signals determined in response to the value 
of the saliency signal". It is noted by the Examiner that the term " capable of . It is noted 
by the Examiner that the term "capable of is non-limiting and therefore has not been 
given patentable weight during examination of the claims on their merits. Language that 
suggests or makes optional but does not require steps to be performed or does not limit 
a claim to a particular structure does not limit the scope of a claim or claim limitation. 
MPEP §2106. 
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The subject matter of a properly construed claim is defined by the terms that limit 
its scope. It is this subject matter that must be examined. As a general matter, the 
grammar and intended meaning of terms used in a claim will dictate whether the 
language limits the claim scope. Language that suggests or makes optional but does 
not require steps to be performed or does not limit a claim to a particular structure does 
not limit the scope of a claim or claim limitation. The following are examples of language 
that may raise a question as to the limiting effect of the language in a claim: 

(A) statements of intended use or field of use, 

(B) "adapted to" or "adapted for" clauses, 

(C) "wherein" clauses, or 

(D) "whereby" clauses. 

This list of examples is not intended to be exhaustive. See also MPEP § 21 1 1 .04. 

USPTO personnel are to give claims their broadest reasonable interpretation in 
light of the supporting disclosure. In re Morris, 127 F.3d 1048, 1054-55, 44 USPQ2d 
1023, 1027-28 (Fed. Cir. 1997). Limitations appearing in the specification but not recited 
in the claim should not be read into the claim. E-Pass Techs., Inc. v. 3Com Corp., 343 
F.3d 1364, 1369, 67 USPQ2d 1947, 1950 (Fed. Cir. 2003) (claims must be interpreted 
"in view of the specification" without importing limitations from the specification into the 
claims unnecessarily). In re Prater, 415 F.2d 1393, 1404-05, 162 USPQ 541, 550- 551 
(CCPA 1969). See also In re Zletz, 893 F.2d 319, 321-22, 13 USPQ2d 1320, 1322 
(Fed. Cir. 1989) ("During patent examination the pending claims must be interpreted as 
broadly as their terms reasonably allow.... The reason is simply that during patent 
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prosecution when claims can be amended, ambiguities should be recognized, scope 
and breadth of language explored, and clarification imposed.... An essential purpose of 
patent examination is to fashion claims that are precise, clear, correct, and 
unambiguous. Only in this way can uncertainties of claim scope be removed, as much 
as possible, during the administrative process.") 

Furthermore, it has been held that the recitation that an element is "capable of 
performing a function is not a positive limitation but only requires the ability to so 
perform. It does not constitute a limitation in any patentable sense. In re Hutchison, 69 
USPQ 138. 

In a first embodiment, Takahashi discloses an apparatus comprising an 
electronic camera (See figs. 4(a), 4(b), 8, 9(a), 9(b), 10, and 11) having a picture taking 
control (shooting button 104 as shown in fig. 4 (b)) for selectively activating the camera 
to derive input picture signals, the electronic camera further including a user operable 
control for generating a saliency signal (Takahashi discloses the use of buttons 109 to 
set auxiliary information (which the Examiner is interpreting as the saliency information) 
related to the image data being captured; page 6, If 0106. Takahashi further discloses 
the use of a pressure sensor 109a and sweat sensor 109b to determine the auxiliary 
information related to the image data (page 6, U 01 12 - page 7, U 01 14). Also 
Takahashi discloses that the auxiliary information includes information related to the 
persons (i.e. son, daughter, friend, father, mother) and a degree of importance of said 
persons appearing in the image data (see figs. 23(a) and 23 (b); page 8,^0117- page 
9, U 0124)) capable of having plural values (as shown in figs. 23(a) and 23(b), the 



Application/Control Number: 10/696,567 Page 44 

Art Unit: 2622 

persons information and degree of importance of the persons in the image can change 
in value between a plurality of values). 

In said first embodiment, Takahashi does not explicitly disclose a buffer for 
receiving the input picture signals and having a capacity for the input picture signals 
determined in response to the value of the saliency signal. 

However, in a further embodiment Takahashi discloses the concept of 
determining the amount of data to be transmitted based on the cost of transmission 
service; wherein the allowed length of data (L) is determined and compared to the 
amount of data to be transmitted, if the amount of data to be transmitted the apparatus 
would select video section with a priority higher than a threshold value. If after selecting 
those video with the priority higher than a threshold, the length of data still more than 
the allowed length, the apparatus would increase the priority threshold, however, if the 
length is less that the allowed length, the video signals are transmitted (Page 12, If 
0151-0154). By teaching adjusting the amount of data to be transmitted based on the 
length allowed for transmission and also based on the priority of the video signals to be 
transmitted, Takahashi inherently discloses "a buffer for receiving said image signal, the 
buffer having a capacity arranged to be controlled by the value of the saliency signal 
during operation of the camera apparatus" as claimed since the amount being adjusted 
in the apparatus needs to be in a particular buffer or memory prior to transmission in 
order to properly select the video signals with higher priority). Takahashi further 
discloses that by adjusting the amount of data to be transmitted based on the length 
allowed for transmission and also based on the priority of the video signals to be 
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transmitted the camera may select as many as possible the most important video 
signals from the video data for transmission (Page 12, If 0154). 

Therefore, taking the combined teaching of the first and the further embodiments 
in Takahashi, one of an ordinary skill in the art would have found obvious at the time the 
invention was made to apply the concepts of adjusting the amount of data to be 
transmitted based on the priority set to the video signals to further modify the camera 
apparatus to have a buffer for receiving said image signal, the buffer having a capacity 
arranged to be controlled by the value of the saliency signal during operation of the 
camera apparatus with the motivation of select as many as possible the most important 
video signals from the video data for transmission as suggested by Takahashi (Page 

12, H0154). 

Regarding claim 52, limitations have been discussed and analyzed in claim 51 . 
Regarding claim 53, limitations have been discussed and analyzed in claim 51 . 

Conclusion 

15. Because new grounds for rejection have been made to unamended claims 12, 

13, 30, 31, 40, 42, 44-48, 50-53, 57 and 59, this Office Action is made NON-FINAL. 
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Any inquiry concerning this communication or earlier communications from the 
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